Scaling-up Child and Youth Mental Health Services: Assessing Coverage of a County-Wide Prevention and Early Intervention Initiative During One Fiscal Year.

PURPOSE: In the U.S., the percentage of youth in need of evidence-based mental health practices (EBPs) who receive them (i.e., coverage rate) is low. We know little about what influences coverage rates. In 2010, the Los Angeles County Department of Mental Health (LACDMH) launched a reimbursement-driven implementation of multiple EBPs in youth mental health care. This study examines two questions: (1) What was the coverage rate of EBPs delivered three years following initial implementation? (2) What factors are associated with the coverage rates? METHODS: To assess coverage rates of publicly insured youth, we used LACDMH administrative claims data from July 1, 2013 to June 30, 2014 and estimates of the size of the targeted eligible youth population from the 2014 American Community Survey (ACS). The unit of analysis was clinic service areas (n = 254). We used Geographic Information Systems and an OLS regression to assess community and clinic characteristics related to coverage. RESULTS: The county coverage rate was estimated at 17%, much higher than national estimates. The proportion of ethnic minorities, individuals who are foreign-born, adults with a college degree within a geographic area were negatively associated with clinic service area coverage rates. Having more therapists who speak a language other than English, providing care outside of clinics, and higher proportion of households without a car were associated with higher coverage rates. CONCLUSION: Heterogeneity in municipal mental health record type and availability makes it difficult to compare the LACDMH coverage rate with other efforts. However, the LACDMH initiative has higher coverage than published national rates. Having bilingual therapists and providing services outside the clinic was associated with higher coverage. Even with higher coverage, inequities persisted.

After the Crisis: Racial/Ethnic Disparities and Predictors of Care Use Following Youth Psychiatric Emergencies.

OBJECTIVE: Youth psychiatric emergencies have increased at alarming rates, and disproportionately so for youth of color. Outpatient follow-up care is critical for positive youth outcomes, but rates of follow-up remain low, especially for racial/ethnic minoritized youth. Mobile crisis response can initiate care connection. The current study (1) describes the population who received mobile crisis response (MCR) within the nation's largest county public mental health system, (2) assesses rates of follow-up outpatient services after MCR, and (3) examines racial/ethnic disparities in outpatient services and correlates of receipt of therapy dose (≥8 sessions). METHOD: Administrative claims for MCR and outpatient services for youth ages 0 to 18 were abstracted from the Los Angeles County Department of Mental Health. RESULTS: From October 2016-2019, 20,782 youth received a MCR, 52.5% of youth were female, and youth mean age was 13.41 years. The majority of youth (91.8%) received some outpatient services after their first MCR. However, only 56.7% of youth received ≥1 therapy session. In a logistic regression, youth age, gender, race/ethnicity, primary language, primary diagnosis, insurance status, MCR call location, and MCR disposition significantly predicted receipt of ≥8 therapy sessions. CONCLUSIONS: Findings highlight disparities in therapy receipt for Asian American Pacific Islander, Black, and White youth (relative to Latinx youth), older youth, youth whose MCR was initiated from a police station call, and youth whose MCR did not result in hospitalization. We discuss priorities for quality improvement for MCR processes and strategies to promote linkage to care to achieve mental health equity.

Patterns of Child Mental Health Service Utilization Within a Multiple EBP System of Care.

The current study (1) characterizes patterns of mental health service utilization over 8 years among youth who received psychotherapy in the context of a community implementation of multiple evidence-based practices (EBPs), and (2) examined youth-, provider- and service-level predictors of service use patterns. Latent profile analyses were performed on 5,663,930 administrative claims data furnished by the county department of mental health. Multinomial logistic regression with Vermunt's method was used to examine predictors of care patterns. Based on frequency, course, cost, and type of services, three distinct patterns of care were identified: (1) Standard EBP Care (86.3%), (2) Less EBP Care (8.5%), and (3) Repeated/Chronic Care (5.2%). Youth age, ethnicity, primary language, primary diagnosis and secondary diagnosis, provider language and provider type, and caregiver involvement and service setting were significant predictors of utilization patterns. Although the majority of youth received care aligned with common child EBP protocols, a significant portion of youth (13.7%) received no evidence-based care or repeated, costly episodes of care. Findings highlight opportunities to improve and optimize services, particularly for youth who are adolescents or transition-aged, Asian-American/Pacific Islander, Spanish-speaking, or presenting with comorbidities.

Developing trauma resilient communities through community capacity-building.

BACKGROUND: Trauma is a significant public health issue, negatively impacting a range of health outcomes. Providers and administrators in public mental health systems recognize the widespread experience of trauma, as well as their limited ability to address trauma within their communities. In response, the Los Angeles County Department of Mental Health funded nine regionally based community partnerships to build capacity to address trauma. We describe partnership and community capacity-building efforts and examine community impact, defined as successful linkages to resources and changes in stress tolerance capacities among community members. METHODS: We conceptualized community capacity-building as dissemination of trauma-informed education and training, community outreach and engagement, and linkage of community members to resources. We measured trauma-informed trainings among partnership members (N = 332) using the Trauma-Informed Organizational Toolkit. Outreach, engagement and linkages were documented using Event and Linkage Trackers. We examined changes in the type of successful linkage after the issuance of statewide mandatory restrictions in response to COVID-19. We examined changes in stress tolerance capacities among community members (N = 699) who were engaged in ongoing partnership activities using the 10-item Conner-Davidson Resilience Scale; the 28-item Coping Orientation to Problems; and the pictorial Inclusion of Community in Self Scale. RESULTS: Training and education opportunities were widespread: 66% of members reported opportunities for training in 13 or more trauma-informed practices. Partnerships conducted over 7800 community capacity-building events with over 250,000 attendees. Nearly 14,000 successful linkages were made for a wide range of resources, with consistent linkage success prior to (85%) and during (87%) the pandemic. In response to COVID-19, linkage type significantly shifted from basic services and health care to food distribution (p < .01). Small but significant improvements occurred in coping through emotional and instrumental support; and sense of community connectedness (p < .05 each). CONCLUSIONS: Community-based partnerships demonstrated effective capacity-building strategies. Despite the pandemic, community members did not report reduced stress tolerance, instead demonstrating gains in external help-seeking (use of emotional and instrumental supports) and perception of community connectedness. Future work will use qualitative methods to examine the impact of community capacity-building and the sustainability of this approach for addressing the impact of trauma within communities.

Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children's mental health services.

BACKGROUND: Although there is increasing investment to implement evidence-based practices (EBPs) in public systems across the USA, continued or sustained use of EBPs after initial implementation remains a challenge. The low integration of EBPs in routine practice severely limits their public health impact, highlighting the need to understand factors that affect the return on costly investments in EBP implementation. This study aims to (1) characterize trajectories of EBP delivery volume through a reimbursement-driven implementation and (2) examine impacts of system-level policy regulatory activity and state-level mental health services funding on the implementation reimbursement strategy. METHODS: This study involved secondary data analyses. Psychotherapy administrative claims and regulatory site visit data from the Los Angeles County Department of Mental Health and California state mental health expenditures were extracted from 2010 to 2017. Multilevel regression examined EBP claims volume over time with state expenditures and regulatory compliance as predictors. RESULTS: EBP claims volume trajectories demonstrated a rapid initial increase, followed by a period of decrease, and a small increase in the final year. State mental health expenditures increased across time reflecting increased funding availability. State mental health expenditures and system regulatory compliance were inversely related to EBP claims volume. CONCLUSIONS: The impact of reimbursement-driven EBP implementation strategy is sensitive to multiple outer-context determinants. At the system level, commitment to fidelity of implementation regulations resulted in reduced use of the reimbursement strategy. Alternative reimbursement streams not tied to EBPs coupled with an expanded array of reimbursable services also impacted the use of the reimbursement strategy to implement EBPs.

Train-to-Sustain: Predictors of Sustainment in a Large-Scale Implementation of Parent-Child Interaction Therapy.

Sustainment of evidence-based practices is necessary to ensure their public health impact. The current study examined predictors of sustainment of Parent-Child Interaction Therapy (PCIT) within a large-scale system-driven implementation effort in Los Angeles County. Data were drawn from PCIT training data and county administrative claims between January 2013 and March 2018. Participants included 241 therapists from 61 programs. Two sustainment outcomes were examined at the therapist- and program-levels: 1) PCIT claim volume and 2) PCIT claim discontinuation (discontinuation of claims during study period; survival time of claiming in months). Predictors included therapist- and program-level caseload, training, and workforce characteristics. On average, therapists and programs continued claiming to PCIT for 17.7 and 32.3 months, respectively. Across the sustainment outcomes, there were both shared and unshared significant predictors. For therapists, case-mix fit (higher proportions of young child clients with externalizing disorders) and participation in additional PCIT training activities significantly predicted claims volume. Furthermore, additional training activity participation was associated with lower likelihood of therapist PCIT claim discontinuation in the follow-up period. Programs with therapists eligible to be internal trainers were significantly less likely to discontinue PCIT claiming. Findings suggest that PCIT sustainment may be facilitated by implementation strategies including targeted outreach to ensure eligible families in therapist caseloads, facilitating therapist engagement in advanced trainings, and building internal infrastructure through train-the-trainer programs.

Prospective predictors of sustainment of multiple EBPs in a system-driven implementation context: Examining sustained delivery based on administrative claims.

Background: System-driven scale-up of multiple evidence-based practices (EBPs) is an increasingly common method used in public mental health to improve care. However, there are little data on the long-term sustained delivery of EBPs within these efforts, and previous studies have relied on retrospective self-report within cross-sectional studies. This study identified prospective predictors of sustained EBP delivery at the EBP-, therapist-, and organizational-levels using survey and administrative claims data within a large-scale system-driven implementation effort. Methods: 777 therapists and 162 program leaders delivering at least one of six EBPs of interest completed surveys assessing perceptions of EBPs and organizational context. These surveys were linked to administrative data to examine prospective predictors of therapists' EBP delivery over 33 months. Results: Five of the six EBPs implemented showed sustained delivery in the system, with volume varying by EBP. Although total EBP claim volume per therapist decreased over time, the volume ratio (ratio of EBP-specific claims to total EBP and non-EBP claims) stayed relatively stable. Multilevel models revealed that EBPs that required consultation, had unstructured content, higher therapist self-efficacy with the EBP, and more positive program leader perceptions of the EBP were associated with greater sustained volume and volume ratio of the EBP. Therapists who were trained in fewer EBPs, who were unlicensed, and who worked in agencies rated by program leaders as lower on organizational staff autonomy and stress showed greater sustained EBP volume and volume ratio. Finally, more direct service hours per week provided by therapist predicted greater sustained EBP volume, but lower volume ratio. Conclusions: The results point to the importance of EBP, therapist, and organizational factors that may be targeted in implementation strategies to promote the sustainment of EBPs.

Mental Health Community and Health System Issues in COVID-19: Lessons from Academic, Community, Provider and Policy Stakeholders.

The coronavirus pandemic of 2019 (COVID-19) has created unprecedented changes to everyday life for millions of Americans due to job loss, school closures, stay-at-home orders and health and mortality consequences. In turn, physicians, academics, and policymakers have turned their attention to the public mental health toll of COVID-19. This commentary reporting from the field integrates perceptions of academic, community, health system, and policy leaders from state, county, and local levels in commenting on community mental health needs in the COVID-19 pandemic. Stakeholders noted the broad public health scope of mental health challenges while expressing concern about exacerbation of existing disparities in access and adverse social determinants, including for communities with high COVID-19 infection rates, such as African Americans and Latinos. They noted rapid changes toward telehealth and remote care, and the importance of understanding impacts of changes, including who may benefit or have limited access, with implications for future services delivery. Needs for expanded workforce and training in mental health were noted, as well as potential public health value of expanding digital resources tailored to local populations for enhancing resilience to stressors. The COVID-19 pandemic has led to changes in delivery of health care services across populations and systems. Concerns over the mental health impact of COVID-19 has enhanced interest in remote mental care delivery and preventive services, while being mindful of potential for enhanced disparities and needs to address social determinants of health. Ongoing quality improvement across systems can integrate lessons learned to enhance a public mental well-being.

Service use by youth with autism within a system-driven implementation of evidence-based practices in children's mental health services.

Public mental health systems play an important role in caring for youth with autism spectrum disorder. Like other dually diagnosed populations, youth with autism spectrum disorder may receive services in the context of evidence-based practice implementation efforts within public mental health systems. Little is known about service use patterns within the context of system-driven implementations efforts for this population. This case-control study examined mental health service patterns of 2537 youth with autism spectrum disorder compared to 2537 matched peers receiving care in the Los Angeles County Department of Mental Health, the largest public mental health department in the United States, within the context of a system-driven implementation of multiple evidence-based practices. Although not the primary target of this implementation effort, youth with autism spectrum disorder were served when they met criteria for the services based on their presenting mental health symptoms. Comparative analyses using administrative claims data were conducted to examine differences in mental health utilization patterns and clinical characteristics. Findings revealed significant differences in the volume and duration of mental health services as well as differences in the service type and evidence-based practice delivered between youth with and without autism spectrum disorder. Results provide direction targeting implementation efforts for youth with autism spectrum disorder within a public mental health system care reform.

Research Community Collaboration in Observational Implementation Research: Complementary Motivations and Concerns in Engaging in the Study of Implementation as Usual.

Implementation research is dominated by studies of investigator-driven implementation of evidence-based practices (EBPs) in community settings. However, systems of care have increasingly driven the scale-up of EBPs through policy and fiscal interventions. Research community partnerships (RCPs) are essential to generating knowledge from these efforts. Interviews were conducted with community stakeholders (system leaders, program managers, therapists) involved in a study of a system-driven implementation of multiple EBPs in children's mental health services. Findings suggest novel considerations in initial engagement phases of an RCP, given the unique set of potentially competing and complementary interests of different stakeholder groups in implementation as usual.

Caregiver Attendance as a Quality Indicator in the Implementation of Multiple Evidence-Based Practices for Children.

OBJECTIVE: This study investigated a quality indicator for children's mental health, caregiver attendance in youth psychotherapy sessions, within a system-driven implementation of multiple evidence-based practices (EBPs) in children's community mental health services. METHOD: Administrative claims from nine fiscal years were analyzed to characterize and predict caregiver attendance. Data included characteristics of therapists (n = 8,626), youth clients (n = 134,368), sessions (e.g., individual, family), and the EBP delivered. Clients were primarily Latinx (63%), male (54%) and mean age was 11; they presented with a range of mental health problems. Three-level mixed models were conducted to examine the association between therapist, youth, service, EBP characteristics and caregiver attendance. RESULTS: Caregivers attended, on average, 46.0% of sessions per client for the full sample and 59.6% of sessions for clients who were clinically indicated, based on age and presenting problem, to receive caregiver-focused treatment. Following initial EBP implementation, the proportion of caregiver attendance in sessions increased over time. Caregivers attended a higher proportion of youth psychotherapy sessions when clients were younger, had an externalizing disorder, were non-Hispanic White, and were male. Further, higher proportions of caregiver attendance occurred when services were delivered in a clinic setting (compared with school and other settings), by bilingual therapists, and the EBP prescribed caregiver attendance in all sessions. CONCLUSIONS: Overall, the patterns of caregiver attendance appear consistent with evidence-informed practice parameters of client presenting problem and age. Yet, several improvement targets emerged such as client racial/ethnic background and service setting. Potential reasons for these disparities are discussed.

Using Survival Analysis to Understand Patterns of Sustainment within a System-Driven Implementation of Multiple Evidence-Based Practices for Children's Mental Health Services.

Evidence-based practice (EBP) implementation requires substantial resources in workforce training; yet, failure to achieve long-term sustainment can result in poor return on investment. There is limited research on EBP sustainment in mental health services long after implementation. This study examined therapists' continued vs. discontinued practice delivery based on administrative claims for reimbursement for six EBPs [Cognitive Behavioral Interventions for Trauma in Schools (CBITS), Child-Parent Psychotherapy, Managing and Adapting Practices (MAP), Seeking Safety (SS), Trauma-Focused Cognitive Behavior Therapy (TF-CBT), and Positive Parenting Program] adopted in a system-driven implementation effort in public mental health services for children. Our goal was to identify agency and therapist factors associated with a sustained EBP delivery. Survival analysis (i.e., Kaplan-Meier survival functions, log-rank tests, and Cox regressions) was used to analyze 19 fiscal quarters (i.e., approximately 57 months) of claims data from the Prevention and Early Intervention Transformation within the Los Angeles County Department of Mental Health. These data comprised 2,322,389 claims made by 6,873 therapists across 88 agencies. Survival time was represented by the time elapsed from therapists' first to final claims for each practice and for any of the six EBPs. Results indicate that therapists continued to deliver at least one EBP for a mean survival time of 21.73 months (median = 18.70). When compared to a survival curve of the five other EBPs, CBITS, SS, and TP demonstrated a higher risk of delivery discontinuation, whereas MAP and TF-CBT demonstrated a lower risk of delivery discontinuation. A multivariate Cox regression model revealed that agency (centralization and service setting) and therapist (demographics, discipline, and case-mix characteristics) characteristics were significantly associated with risk of delivery discontinuation for any of the six EBPs. This study illustrates a novel application of survival analysis to administrative claims data in system-driven implementation of multiple EBPs. Findings reveal variability in the long-term continuation of therapist-level delivery of EBPs and highlight the importance of both agency and workforce characteristics in the sustained delivery of EBPs. Findings direct the field to potential targets of sustainment interventions (e.g., strategic assignment of therapists to EBP training and strategic selection of EBPs by agencies).

Integrated Primary Care in Assertive Community Treatment.

Assertive community treatment (ACT) has the potential to serve as a medical home for adults with serious mental illness, a population that experiences some of the most significant health disparities in the United States. Using site visit methodology, the authors describe partnerships that were created between five ACT programs and federally qualified health centers (FQHCs) to provide integrated behavioral health and primary care. The authors examined rates of screening for common chronic conditions. The programs used three distinct approaches: two programs colocated ACT teams at an FQHC, two programs employed primary care providers who split their time between the FQHC and the ACT program, and one program embedded a primary care provider within the ACT team. Effective communication between staffs may be more important than type of partnership in determining integration success.

Health Outcomes and Costs Associated with the Provision of Culturally Competent Services for Underrepresented Ethnic Populations with Severe Mental Illness.

Underrepresented racial/ethnic populations (UREPs) face disparities in their use of behavioral health services for multiple reasons including lack of culturally competent services and stigma. This paper employs mixed methods to compare health outcomes and costs among clients in 14 culturally competent behavioral health programs targeting specific UREPs to five programs without a specific racial or ethnic focus. We found that UREP-focused programs were associated with similar improvements in health outcomes, but greater costs relative to the comparison programs. Main themes from the qualitative analysis included: addressing stigma, building trust and understanding confidentiality, looking for a cure, and moving beyond linguistic competency.

Implementation of Integrated Health Homes and Health Outcomes for Persons With Serious Mental Illness in Los Angeles County.

OBJECTIVE: The Medicaid health home option of the Affordable Care Act provides a new opportunity to address the fragmented system of care for persons with serious mental illness. This study examined the implementation of integrated health homes in Los Angeles County. METHODS: Longitudinal data on client-reported physical health status, clinician-reported mental health recovery, and screening for common chronic conditions among 1,941 persons enrolled in integrated care programs for serious mental illness and chronic general medical illness were combined with site visit data measuring the level of integration of general medical and mental health care among ten integrated care programs. Various analyses were used to compare outcomes by level of program integration (generalized estimating equations for physical health status and mental health recovery and logistic regression and chi-square tests for screening for common chronic conditions and clinical risk factors). RESULTS: Clients in more highly integrated programs had greater improvements in physical health status and mental health recovery and higher rates of screening for common chronic conditions compared with clients in less integrated programs. They also had greater reductions in hypertension but a worrisome increase in prediabetes and diabetes. CONCLUSIONS: Highly integrated mental health and general medical programs were associated with greater improvements in health outcomes compared with less integrated programs. Additional research is necessary to identify predictors of integration, to determine which aspects of integration drive improvements in health outcomes, and to identify strategies to increase integration within less integrated programs. Efforts are needed to coordinate pharmacotherapy, including increased consideration of the metabolic effects of antipsychotic medication.

Measuring Sustainment of Multiple Practices Fiscally Mandated in Children's Mental Health Services.

Examining sustainment of multiple evidence-based practices is crucial to understanding the processes and outcomes of system-driven implementation efforts that are increasingly common. This study used administrative claims data to characterize volume and penetration of six practices over 19 fiscal quarters following initial implementation within the context of a system-driven, fiscally mandated implementation effort in Los Angeles County Department of Mental Health's Prevention and Early Intervention services. Patterns of volume changes over time revealed an overall ramp up of practice claims over time, but variability in patterns of volume and penetration for each practice. Findings varied by the methods used to index and analyze volume and penetration. Furthermore, a number of client case-mix and therapist characteristics were associated with the volume of therapists' claims for each practice relative to their claims for the other practices.

Providers' attitudes toward evidence-based practices: is it just about providers, or do practices matter, too?

Evidence-based practice (EBP) attitudes were measured in a sample of Los Angeles County mental health service providers. Three types of data were collected: provider demographic characteristics, attitudes toward EBP in general, and attitudes toward specific EBPs being implemented in the county. Providers could reliably rate characteristics of specific EBPs, and these ratings differed across interventions. Preliminary implementation data indicate that appealing features of an EBP relate to the degree to which providers use it. These findings suggest that assessing EBP-specific attitudes is feasible and may offer implementation-relevant information beyond that gained solely from providers' general attitudes toward EBP.